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United States Patent Application For: 

METHOD AND APPARATUS FOR SIZE 
ANALYSIS IN AN IN VIVO IMAGING SYSTEM 

CROSS REFERENCE TO RELATED APPLICATIONS 

This application claims benefit from prior provisional application serial 
number 60/433,765 filed December 17, 2002, entitled "METHOD AND 
APPARATUS FOR SIZE ANALYSIS IN AN IN VIVO IMAGING SYSTEM." 

FIELD OF THE INVENTION 

The present invention relates to an in-vivo device, system and method 
such as for imaging an in-vivo lumen; more specifically, to a method and apparatus 
in an in-vivo system for determining the size and/or distance of an in-vivo object. 

BACKGROUND OF THE INVENTION 

Devices and methods for performing in-vivo imaging of passages or 

cavities within a body are known in the art. They may include, for example, 
swallowable capsules which collect data and which may transmit the data to a 
receiver system. Such devices may also include, inter alia, various endoscopic 
imaging systems and devices for performing imaging in various internal body 
cavities. 

An in-vivo imaging device may include, for example, an imaging system 
for obtaining images and other data from inside a body cavity or lumen, such as 
the gastrointestinal (Gl) tract. The imaging system may include, for example, an 
illumination unit, such as a set of light emitting diodes (LEDs), or other suitable 
light sources. The device may include an imaging sensor and an optical system, 
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which focuses the images onto the imaging sensor. A transmitter and antenna 
may be included for transmitting the image signals. A receiver/recorder, for 
example worn by the patient, may record and store image and other data. The 
recorded data may then be downloaded from the receiver/recorder to a 
computer or workstation for display and analysis. 

Upon display or analysis of the images obtained from the device, it 
would be useful to be able to determine the size of objects viewed, such as for 
example tumors or polyps. 

SUMMARY OF THE INVENTION 

An embodiment of the device, system and method of the present invention 

enables the estimation or determination of the size of objects seen in in-vivo 
images from within body lumens or cavities, such as the gastrointestinal (GI) tract. 
According to an embodiment of the invention, calculations according to a certain 
algorithm(s) are performed on the images in order to present to an observer an 
estimation of the real size (or distances) of the objects in the image or provide an 
observer with a visual tool or guide aiding the observer in making such an 
estimation. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated more fully from 

the following detailed description taken in conjunction with the drawings in which: 

Fig. 1A shows a schematic diagram of an in-vivo imaging system 
according to one embodiment of the present invention; 
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Fig. 1B is a perspective view of a lens, filter, or other device including a 
scale or other indication; 

Figs. 2A and 2B are examples of scales used with an in-vivo imaging 
system with a non-linear scale, reference frame, or other set of lines, bars, 
numbers, indicators, etc. overlaid or added to on an image in accordance with 
embodiments of the present invention; and 

Fig. 3 depicts a series of steps of a method according to an embodiment 
of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

In the following description, various aspects of the present invention will be 

described. For purposes of explanation, specific configurations and details are set 
forth in order to provide a thorough understanding of the present invention. 
However, it will also be apparent to one skilled in the art that the present invention 
may be practiced without the specific details presented herein. Furthermore, well 
known features may be omitted or simplified in order not to obscure the present 
invention. 

Embodiments of the system and method of the present invention may be 
used in conjunction with an imaging system or device such as embodiments 
described in U.S. patent 5,604,531 to Iddan et al. and/or in application number 
WO 01/65995 entitled "A Device And System For In-vivo Imaging", published on 
13 September, 2001, both of which are hereby incorporated by reference. 
However, the device, system and method according to the present invention 
may be used with any suitable device, system and method providing imaging 
and other data from a body lumen or cavity. 
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Reference is made to Fig. 1A, which shows a schematic diagram of an 
in-vivo imaging system according to one embodiment of the present invention. In 
an exemplary embodiment, a device 40 may be, for example, a swallowable 
capsule capturing images and possibly other data. Typically, device 40 is in the 
shape of a capsule, including at least one dome-shaped end 50; however, other 
shapes may be used, and the device need not be swallowable or a capsule. 
Typically, device 40 includes at least one sensor such as an imager 47, for 
capturing images, and a processing chip or circuit 41 that processes the signals 
generated by the imager 47. Processing circuit 41 need not be a separate 
component; for example, processing or a processing chip may be integral to the 
imager 47. An illumination device 42, such as a set of light emitting diodes (LEDs), 
or other suitable light sources, provides light to illuminate objects. An optical 
system, including, for example, one or more optical elements, such as one or more 
lenses 46 or composite lens assemblies (not shown), one or more suitable optical 
filters (not shown), or any other suitable optical elements (not shown), may aid in 
focusing reflected light onto the imager 47 and performing other light processing. 
Device 40 may be, for example, similar to embodiments described in U.S. Patent 
No. 5,604,531 and/or WO 01/65995, described above. However, the device may 
be any sort of in-vivo sensor device and may have other configurations. For 
example, the device may be an endoscope. 

Embodiments of the device are typically autonomous and are typically 
self-contained. For example, the device may be a capsule or other unit where all 
the components are substantially contained within a container or shell, and where 
the device does not require any wires or cables to, for example, receive power or 
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transmit information. The device may communicate with an external receiving and 
display system to provide display of data, control, or other functions. For example, 
power may be provided by an internal battery or a wireless receiving system. 
Other embodiments may have other configurations and capabilities. For example, 
components may be distributed over multiple sites or units. Control information 
may be received from an external source. 

According to one embodiment device 40 typically includes a transmitter 
43, for transmitting image and other (e.g., non-image) information to a receiving 
device, and may include other components. The transmitter 43 is typically an ultra 
low power radio frequency (RF) transmitter with high bandwidth input, possibly 
provided in chip scale packaging, and may be combined with processing chip or 
circuit 41 , as shown in Fig. 1 A. The transmitter 43 may transmit via for example an 
antenna 48. The transmitter 43 may also act as a controller and include circuitry 
and functionality for controlling the device 40, although a separate control unit may 
be used. Typically, the device includes a power source 45, such as one or more 
batteries. For example, the power source 45 may include silver oxide batteries, 
lithium batteries, or other electrochemical cells having a high energy density, or the 
like. Other power sources may be used. 

Other components and sets of components may be used. For example, 
the power source may be capable of receiving power from an external power 
source transmitting power to the device 40, and a controller separate from the 
transmitter 43 may be used. 

In one embodiment, the imager 47 is a complementary metal oxide 
semiconductor (CMOS) imaging camera. The CMOS imager is typically an ultra 
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low power imager and is provided in chip scale packaging (CSP). Other types of 
CMOS imagers may be used. In another embodiment, another imager may be 
used, such as a CCD imager, or another imager. 

Preferably, located outside the patient's body in one or more locations, 
external to the in-vivo device 40, are a receiver 12, preferably including an antenna 
or antenna array 15, for receiving image and possibly other data from device 40, a 
receiver storage unit 16, for storing image and other data, a data processor 14, a 
data processor storage unit 19, and an image monitor 18, for displaying, inter alia, 
the images transmitted by the device 40 and recorded by the receiver 12. 
Typically, the receiver 12 and receiver storage unit 16 are small and portable, and 
are worn on the patient's body during recording of the images. Preferably, data 
processor 14, data processor storage unit 19 and monitor 18 are part of a personal 
computer or workstation, which includes standard components such as a 
processor or other controller 13, a memory (e.g., storage 19, or other memory), a 
disk drive, and input-output devices, although alternate configurations are possible. 
In alternate embodiments, the data reception and storage components may be of 
another configuration. In addition, a data decompression module for 
decompressing data may also be included. 

The receiving and recording components may be, for example, similar to 
embodiments described in the above-mentioned U.S. Patent No. 5,604,531 and/or 
WO 01/65995. However, the receiving and recording components may be of other 
suitable configurations and include other suitable functions. 

It may be desired in such a system to capture via the optical system as 
great a viewing angle as possible. Typically, this may distort the image in such a 
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way that the further an object from the center, the greater it is magnified; thus a 
distortion effect may be produced. Other distortion effects may be produced. For 
example, an object viewed at the edge of the display area may seem three (3) 
times as long as if it was seen at the center of the display area (other suitable 
distortion ratios may be used). This distortion ratio, e.g., the relative difference in 
size between an object at the center and a similarly sized object displaced from the 
center as a function of angular displacement of the object from the center of the 
dome, may be linear or non-linear, and may vary with different embodiments or 
different imaging systems. While - for purposes of illustration, an example of a 
linear distortion ratio is provided, those of skill in the art will recognize that 
analogous calculations may be made in accordance with the present invention for 
other imaging systems. It should be emphasized that although the distortion of the 
optical system typically has radial symmetry, the present invention is not limited to 
this type of optical systems. It should further be emphasized that the present 
invention is not limited to in-vivo imaging systems having a dome-shaped window, 
but rather that the same principles described may be used with in-vivo systems 
having windows of another shape, such as a plane or a cone. 

Fig. 1B is a perspective view of a lens, filter, or other device including a 
scale or other indication. Scale or indication 56 may be included in device or 
transparent piece 55 in various suitable known manners, such as printing, 
etching, raised or indented printing, etc. 

In accordance with one embodiment of the present invention, a scale 
such as scale 56 (Fig. 1 A, Fig. 1 B) may be overlaid or otherwise added to on the 
displayed image to give an estimate of the sizes of objects. Such a size 
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estimate may be, for example, provided to a user at a processing and/or display 
system, may be produced by a user comparing an object to a scale, or by other 
methods. Various suitable scales such as reference frames or indications may 
be used, such as sets of lines, bars, numbers, indicators, etc. For example, a 
scale may be placed by drawing or etching it onto the dome or other transparent 
piece as shown in Figs. 1A and 1B. Other devices may be used to add a scale 
to an image, such as a lens, filter, or other relatively clear device or transparent 
piece with a scale printed, etched or otherwise added to it, by adding such a 
scale to an imaging device, etc. In other embodiments, such a scale may be 
overlaid onto the image at any stage of the imaging process, for example, at the 
processing circuit 47, at processing circuits (e.g., CPUs, processors, specialized 
circuits, etc.) in other devices such as in the data processor 14, or at the monitor 
18. Such digital addition of image elements to a video image is well known. 
The markings on the scale may be placed in accordance with the distortion 
pattern of the optics system used by a particular device. A set of reference lines 
on the scale may be, for example, orthogonal coordinate axes (e.g., cartesian 
coordinates), radial lines and concentric circles (e.g. polar coordinates), etc. If 
the scale is provided by the data processor 14 or at the monitor 18, in one 
embodiment the user may be able to toggle the scale on or off. Fig. 2A is an 
example of a scale, typically displayed on image monitor 18, of an in-vivo 
imaging system with a typically non-linear orthogonal scale overlaid on an image 
in accordance with an embodiment of the present invention. Fig. 2B is an 
example of a scale, typically displayed on image monitor 18, of an in-vivo 
imaging system with a typically non-linear polar scale overlaid on an image in 
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accordance with an embodiment of the present invention. Scales 56 may have 
other suitable forms. It will be noted that in the example provided, markings at 
the outer portions of the viewing area are further apart than those at the center 
because the distortion particular to the embodiment shown magnifies images at 
the edge of the display relative to those at the center. Typically, an object 
measuring one unit at the edge of the viewing area should be roughly the size of 
one unit at the center. Other types of scales, indications or markings may be 
provided in accordance with various embodiments of the invention to provide a 
scale to a viewer, enabling the viewer to estimate the size of various objects 
seen. For example, a set of colors or shading gradients may be used. Numbers 
may be provided on the scale, providing estimates or ranges whereby the viewer 
may roughly estimate the size of viewed objects. 

In another embodiment of the invention, the image may be digitally 
processed and altered in accordance with the distortion pattern of the optical 
system to compensate for the distortion. Upon displaying a digitally corrected 
view of an image, a linear measuring grid may be overlaid on the processed 
image. 

The approximate size of an object can be determined by knowing the 
size of the dome of the device 40 and the illumination range of the illumination 
device. According to one embodiment, for example, the radius of the dome of 
an in-vivo imaging device is approximately 0.7 cm and the effective range of the 
illumination provided by an in-vivo device is approximately 3.0 cm. Moreover, a 
typical viewing angle may be approximately 110° to 140°. For purposes of 
illustration, a viewing angle of 120° is assumed. Thus, based on simple 
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trigonometric calculations, the effective viewing diameter of circular images 
displayed may be calculated. For the example given, an object directly in front 
of the dome spanning the entire display would be approximately 2.4 cm, 
whereas an object at the maximum viewing distance that spans the entire 
display would be approximately 5.2 cm. While these figures, dimensions and 
distances may vary with different embodiments or different imaging systems, 
analogous calculations may be made for other imaging systems in accordance 
with embodiments of the present invention. 

Thus, knowing, for example, the distortion ratio, maximum angle, and 
maximum and minimum distance of the optical system, a range of sizes may be 
assigned to an object filling some or all of the display or image based on its 
possible distance from the dome. Such ranges may be printed on a screen 
overlay. It will be clear to those of skill in the art that it is possible to calculate 
such a range of sizes for objects between the center and the edge of the viewing 
area based on simple principles of extrapolation for any optical distortion ratio, 
maximum angle, and maximum and minimum distance of the optical system. 
For many medical purposes, a range of sizes for an object such as provided by 
the above illustration may suffice. For example, the size of a polyp may 
correlate to the time until when it will turn cancerous. Knowledge of the size of a 
polyp therefore may enable a physician or other user of a system in accordance 
with the present invention to decide about urgency of the treatment, type of the 
treatment, and tools required for the treatment. 

In addition, these estimates may be further refined based upon more 
specific knowledge of the distance of the object from the device 40. Various 
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suitable methods of determining the distance or estimated distance of an object 
may be used. The known intensity of the illumination emanating from 
illumination device reflected by objects viewed correlates to their distance from 
the device. This intensity of reflected illumination may be measured by the data 
processor 14. Thus, for example, an object that reflects light only dimly is 
towards the far end of the illumination range, whereas an object that reflects 
light brightly is closer to the dome of the device. For the sake of simplicity, it 
may be assumed that the distance to an object is inversely proportional to its 
reflection coefficient. In one embodiment, such calculations can be based on 
the reflection coefficient or other known reflectance characteristics of the object 
being analyzed. For example, the user may indicate an object or class of 
objects (e.g., polyps), for which the data processor 14 has stored characteristics 
such as, for example, a known average reflectance, or the user may enter a 
certain reflectance. Such reflectance, combined with the known illumination 
intensity and possibly other information (transparency of Gl fluids), may be used 
to calculate a distance or distance range. Other suitable characteristics may be 
used. 

Such distance or distance range may be used to calculate the estimated 
size of the object. Based on this illustration, it will be clear to those of skill in the 
art that it is possible to calculate a range of sizes for objects based on the 
degree of reflection by an object of the illumination for any sort of objects whose 
illumination reflection characteristics are known. In accordance with 
embodiments of the invention, once the distance to the edges of an object have 
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been calculated, its size may be determined by simple trigonometric 
calculations. 

Size calculation may be performed manually, e.g., by having a user 
compare an object to a scale, or by a computing device, such as a controller 
within in-vivo device 40, or by, for example, components such as receiver 12, 
data processor 14, processor 13, etc. Other suitable components may perform 
such a calculation. An object to be sized may be determined automatically or 
may for example be selected by a user. A request for size estimate or analysis 
may be made by a user, or this may be done automatically. Object or pattern 
recognition techniques may be used to determine the shape or outline of an 
object. A user may indicate the outline of an object or an object itself. For 
example, a user may indicate two (or other numbers of) points on a monitor by, 
for example, using a pointing device to indicate coordinates on an image. For 
example, a user may select an image, and may move a pointing device such as 
a mouse over two or more points on an object, indicating, for example, a line to 
be sized (if two points are determined), or an outline of an image to be sized (if 
more^points are determined). For example, by estimating a distance between a 
first point and a second point, the points generally corresponding to the largest 
visible dimension of an object, an estimate of the size of the object may be 
obtained. 

Fig. 3 depicts a series of steps of a method in accordance with an 
embodiment of the present invention. In step 100, an image is captured by an 
in-vivo imaging device. 
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In step 110, a scale or other indication may be added to or overlayed on 
the image. This may be done, for example, by imaging using a device including 
a scale (e.g., on a lens, on an optical dome, on a filter, on an imager, etc.), by 
adding the scale at a later point (e.g., by the imaging circuitry, by a post 
processing device), or by other methods. The scale or other indication may be 
added in an in-vivo device or, for example, at a processing device external to the 
in-vivo device (e.g., an external receiver, an external workstation, etc.). 

In step 120, a request for size estimate or analysis may be made, for 
example, by the user's indicating two (or other numbers of) points on a monitor 
or by the data processor using computer image analysis techniques. Such an 
explicit request need not be provided. 

In step 130, the distance (or range of possible distances) may be 
analyzed or calculated, or otherwise obtained. Such distances may be 
determined beforehand - e.g., a fixed range of possible distances for any object 
imaged may be known or determined. In step 140, a size, distance or other 
result may be calculated. In step 150, an estimated size, distance or other result 
may be displayed or otherwise provided. Other steps or series of steps may be 
used. For example, an explicit size analysis need not be used - for example, a 
user may simply use a scale to estimate the size of an object. 

The user of an in-vivo imaging system employing an embodiment of the 
present invention may, for example estimate the size of an object viewed on the 
monitor or other image display device. This measurement estimate may be 
made manually or automatically. For example, by comparing the dimensions of 
an object viewed on the monitor, and comparing to the gridlines, a user may 



13 



P-5452-US 



estimate the size of the object. Alternately, this estimation may be performed 
automatically. A user may, for example, choose two points on the display (e.g., 
using a mouse or other user interface with the processing unit), possibly 
corresponding to the edges of an object, and the data processor 14 unit may 
provide a range of distances between the two points indicated, depending on the 
distance between the lens and the object (e.g., "The two points indicated are 
between 1.7 and 3.6 cm apart."). Other methods of inputting a user indication of 
an object and outputting a size or size range may be used. Alternately, the data 
processor 14 or other unit may choose an object or distance on an object, for 
example an object identified using computer image analysis techniques. This 
may be particularly useful for example where polyps of a certain size range 
(e.g., 0.5mm to 1.5mm) may be diagnosed differently from a polyp of a larger 
size range (e.g., 1cm-3cm). Thus, in this example, using an embodiment of the 
present invention, even a range of sizes may provide useful for diagnosing one 
type of polyp or another. 

While the invention has been described with respect to a limited number 
of embodiments, it will be appreciated that many variations, modifications and 
other applications of the invention may be made. Embodiments of the present 
invention may include apparatuses for performing the calculations and 
operations herein. Such apparatuses may be specially constructed for the 
desired purposes or may comprise general purpose computers selectively 
activated or reconfigured by a computer program stored in the computers. Such 
computer programs may be stored in a computer readable storage medium, 
such as, but is not limited to, any type of disk including floppy disks, optical 
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disks, CD-ROMs, magnetic-optical disks, read-only memories (ROMs), random 
access memories (RAMs), electrically programmable read-only memories 
(EPROMs), electrically erasable and programmable read only memories 
(EEPROMs), magnetic or optical cards, or any other type of media suitable for 
storing electronic instructions. 

The processes presented herein are not inherently related to any 
particular computer or other apparatus. Various general purpose systems may 
be used with programs in accordance with the teachings herein, or it may prove 
convenient to construct a more specialized apparatus to perform the desired 
method. The desired structure for a variety of these systems appears from the 
description herein. In addition, embodiments of the present invention are not 
described with reference to any particular programming language. It will be 
appreciated that a variety of programming languages may be used to implement 
the teachings of the invention as described herein. 

Unless specifically stated otherwise, as apparent from the discussions 
herein, it is appreciated that throughout the specification discussions utilizing 
terms such as "estimating", "processing", "computing", "calculating", 
"determining", or the like, typically refer to the action and/or processes of a 
computer or computing system, or similar electronic computing device (e.g., a 
"computer on a chip" or ASIC), that manipulate and/or transform data 
represented as physical, such as electronic, quantities within the computing 
system's registers and/or memories into other data similarly represented as 
physical quantities within the computing system's memories, registers or other 
such information storage, transmission or display devices. 
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It will be appreciated by persons skilled in the art that the present 
invention is not limited to what has been particularly shown and described 
hereinabove. Rather the scope of the present invention is defined only by the 
claims, which follow: 
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